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eroun with AGCT (I.Q. Equiv.) scores ranslisg froa 100 to 130. Table 1 S^ves 
the results of this project in a summarizad fora for both Electronics and A^o- 
aechanics. In the case of the Aray. the FORECAST students did as well in 407. 
of the trainlnc^ time as the Control Group students. In this case, It is 
necessary to concentrate on the Upper Bucks County School data, 8^000 

the one instance where all the elements of the methodology were present at one 
time— the progra-c^med instruction materials, the computer, the experimental 
and control groups in Electronics, and a curriculum which was new enough to 
oermit SOS to bs^able to help balance the course content between the control and 
experimental groups so that both groups were being taught technical oainte^nce 
Serial in Electronics which was identical in precedence as well as in actual 
conduct. In this case, time of exposure to such subject matter can 
be equal, and holding such subject matter equal, it becomes 
only was statistical significance achieved but that the final proficiency t 
scores of the Experimental Group were almost 40% higher than those of the 

Control Group. 



<B) Conclusions and Interpretation: 



1. The SOS combined computer-assisted methodology works well in Electronics 
in every case; and where, previous electronics subject matter taught can be 
controlled, it is significantly better at the 27. level of confidence, ^ere a 
good deal of previous subject matter had already been taught the 
where the SlIART computer was not yet available, as was the case at Dobbins 
(urban) it did as well as the control group. 



2. The lack of a significant difference in Auto-mechanics may be due to 
the fact that the rural students at Bucks do a great deal of motor and fara ^ 
machinery repair froa an early age, and that it was not as co^lete a CAI course 
(only tijo prepared programs in Auto) as could have been possible, more time and 
funds and application in an urban environment might produce different results. 



3 In every case, the intrinsic interest in solving problems on the com- 
puter, *which is much like playing a game with a pin-ball machine as the lights 
liRht the slides with the voltage readings and wave- forms appear, and where 
the machine gives the student immediate reward when ha localizes the correct 
source of the trouble by removing the malfunction indications and restoring 
the system to an operational or "green light" status, all these contributed 
to a hiph decree of motivation on the part of the student. Where the student 
is motivated" as in this case, and where the device lends itself to self-instruc- 
tion, there are obvious implications for its use in study halls, for additional 
after-class troubleshooting practice, and for its universal use, as the range 
of subject matter is limited only by the ability of programmers to convert 
applicable educational curricula into the software required for computer out- 

put. 
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4. Language comprehension which in turn implies the successful full re- 
ceipt of the bits of intelligence the sender is crying to convey to the listener, 
seems to be the source of most difficulties. In the case of this CAl-FI 
methodology', language was Uvsed as little as possible, insofar as charts, graphs, 
accurate schematic and block diagrams dynamically presented to show the relation- 
ships of various components of a system, and even cartoon-like figures and 
drawings in the PI books were utilized instead of words. (Especially instead of 
those words which were long, flowery and above the reading level of the student) . 
The results are rather Interesting in terms of the apparent ability of the lc^7er 
I.Q. students to master the materials when prestructured by presumably Intelligent 
education research personnel for them that their (the students frequency) may 
be tuned in on so that as the educational course materials are transmitted by 
computer, by programmed instruction book, or even by instructor, that they be 
received with a maximum degree of efficiency, e.g., that the student perceive, 
comprehend, retain and be able to recall the material later in the right context 
and from the appropriate cues. It was not v;ithout some faith in this approach, 
that the original research team referred to it as cue-response, that I used data- 
flow pattern techniques with gaming and iinmediate reinforcement in the USAF Atlas 
technician training program with many favorable responses and promising results. 
Now that additional data has been procured on this project to further support 
the systems data-flow pattern recognition approach to technical training . (and 
with considerable*, reinforcement from the success of a current Navy project deal- 
ing with radar, computer and weapons direction equipment repair) it would seem 
that the next step would outdistance or take one jump of a greater magnitude by 
applying the methodology outside of the predominant language -cultural group to 
see if it is basic enough to the learning process to again produce results in . 
technical training, which with e:2psrieccs and refinement, may make the technical 
approach tested here of wide and useful application. 
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TABLE 3 

. High vs Low I.Q. ' 
Montgomery County - Exp. for Test 



Subj . 
No. 



Otis above 109 



Subj . 
No. 



Otis below 108 



1. 


92 


12. 




73 


2. 


74 


13. 




77 


3. 


64 


> 

14. 




80 


4. 


66 


15. 




89 


5. 


70 


) 

16. 




55 


6. 


74 


17. 




60 


7. 


77 


18. 




63 


8. 


65 


> 19. 




86 


9. 


77 













10 . 

ill. 



79 

68 



X - 72.87 



^ " 8oe 

X - 73.27 
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f ^ 
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1 * 


i< 
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2 « 


i X 





^ - 43,569. 



11 



73.27-72.87 



43,569 -(583)'^ - 1082.87 



4.7022 

0850 



8 



Sxl-x2 " 




+ 1082.87 



8-2 






with 17 degrees freedom 
.05 “ .2110 



" Y(102.4150) (.2159) - 4.7022 



ijiot significant 
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8.2 Figures ; 



FIGURE 1 

Training Time and Performance Comparison, Army Cue-Response 
Standardization Group. 
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1. Progrf rcmed text entitled: 
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Teclinical Instruction Manual" 
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FIRST QUARTERLY SUMMARY 

Ob.lectives ; 

1. To determine the difference in performance between 

(a) students enrolled in a military-type computer-based instructional 
prograni in electronics and (b) students enrolled in a conventional 
instructional program in electronics, with both groups of students 
being drawn from a high school population with an I.Q. range from 
100 to 130 (and higher). . 

2. ' To. determine the effectiveness of the military-type 
computer-based instructional program in electronics when used on 
a lower I. Q. range (78 to 112) group of students. 

3 . To determine the effectiveness of the military- type 
computer-based instructional system when used in a different subject 

t 

area: Auto-mechanics. 



Procedures : 

The project will utilize a computer-based instructional system 
which has proved to be very effective in military training programs. 
The system will involve the Cue -Response programming method, "SNAP” 
programmed texts, and programmed overlays for the "SMART" Trainer 
(a universal simulation and representation device which can be 
tailored to a specific course merely by changing the student's 
panel and plugboard programming.) 

Course materials in two courses (Electronics and Auto-mechanics) 
will be programmed on the basis of the Cue-Response method resulting 
in the production 'of "SNAP" prograrrirned texts and programmed overlays 
for the "SMART'* Trainer. For the Electronics Course, materials 





















supplemented and adapted for civilian high school use. For the 
Auto-mechanics Course, ne\^r materials wijl.I be developed specifically 
for this project. Two vocational high schools (Dobbins Technical 
High School, Philadelphia, Perina. and the Upper Bucks County 
Technical High School, Perkasie, Penna. will be the locales for 
the experiment) . 



i 

Accomplishments ; 

■ Electronics Course materials, using some content of previous 

5' H 

military courses, are well on their way in development. After 
I intensive analysis, five overlays for the "SMART” Trainer were 

[ defined, each capable of providing up to 25 malfunction problems. 

i 

I "SNAP" Programmed instruction materials have been in preparation 

f 

j for both courses. Two overlays were defined for the Auto -mechanics 

i. . . 

Course; and, the statistician- logician prepared the logic equations 
j for translation to the wiring diagrams for the plugboard for the 
first Auto-mechanics- Course overlay -- the overall block diagram. - 

I The other six overlays will have their logic equations developed 

I ' 

as each layout is reviewed, revised and approved. Malfunction 
1 locations and their resultant system ramifications for each overlay, 
together with the appropriate tests and associated slides of 

j, waveforms, voltage readings, etc., are in preparation. The hardware 
manufacturer predicts delivery of the "SMART" Trainers on schedule. 

In a meeting held with USOE, approval was obtained for minor 



■ changes in the project, resulting from the intensive analysis of 

I' ‘ ^ ' 

course content. Numbers of overlays, plugboards, and slide packages ‘ 




Maaiaaife^^ 













were changed as a result of the analysis. Increased participation 



of the high school instructors, resulting from meetings held at the 
■ high schools, made it possible to eliminate both the second Electron- 
ics and the second Auto-mechanics "experimental'* course instructors, 

I ^ 

I 

and approval was obtained to procure 20 T.V. sets and necessary 
test equipment in order to assure having the tools for a standardized 
end-of-course proficiency examination for all electronics students, . 

I Frequent meetings, or telephone conversations, were held with the 
consultant in' order to take full advantage of the experience with 
materials prepared for previous military electronics courses which 
I used the Cue-Response method; and, the current NAVY-LORAN course 
facility was visited in order to take advantage of any recent 
innovations that may have been developed, 
j. Plans for the next Quarter Include the completion of the logic 

I for the complete set of overlays with all malfunction problems 

t * 

I associated with each one, the "debugging" of the urogrammed plug- 
I boards with associated overlays and slides on the "SMART" Trainer, 

I the completion of the programmed Instruction books, and the beginning 

i ‘ ‘ 

f. 

[ of the courses of Instruction at the respective participating high 

I 

i schools, 

I ■ 
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!• Work Completed During First Quarter 

The project was initiated officially on 1 April I966. Staff 
members of SOS were assigned to the project group and began work 
immedi.ately. Analysis of the course contents and schedules was begun 
for the Electronics Courses at the Dobbins Technical High School and 
the Upper Bucks County Technical-Vocational High School, and, for 
the Auto-mechanics Course at the latter school only. Meetings v;ere ' 
held with the principals, technical education directors and instructors 
concerned with each of these courses, respectively. 



For the Electronics Course, frequent meetings and telephone 
conversations were held with the Project Consultant in order to take 
full advantage of his experience and the Electronics Course materials 
from the military training applications with which he has been con- 
cerned in the past. Meeting dates are listed in Table.!. SOS 
personnel reviewed these materials, extracted the useful content, 

and, with considerable expansion, are preparing experimental course 
materials from them. 

After lengthy analysis, the overlays for the ‘’SMART” were 
defined; and, -work was begun on the writing of . the ’’SNAP” programmed - 
instruction texts. Cooperation of the electronics instructors at the 
two high schools was obtained in adapting their regular ’’control 
group” courses, so that course content and schedules may be the same 
as with the ’’experimental group” courses. Due to difficulties in 
making student assignments, it was decided to use a statistical 



separation of I. Q.* levels, rather than a classroom separation. The 

* » 

numbers of students currently assigned to each of the Electronics 
Course classes are shorn in Table 2 . ’ 
















Preparation of the Auto -mechanics Course materials was conducted 
by 30S personnel without the benefit of any military course precedent. 
Tv;o block diagram overlays for troubleshooting training of auto systems 
on the ’’SMART” Trainer were prepared; and, the ’’SNAP” programmed 
instruction manuals for the Auto-mechanics Course were in preparation. 



Close cooperation with the Auto-mechanics instructor at the Upper 

Bucks County Technical-Vocational High School has enabled the 

preparation of .two parallel scheduled course contents for the 

’’experimental” and ’’control” groups, respectively. Table 3 presents 
% 

the student assignments to the Auto-mechanics courses. 

In the case of the Electronics Course, content analysis indi- 
cated that the ’’SMART-SNAP” approach could be effectively implemented 
by having the troubleshooting training period, with an SOS instructor 
using the ’’SMART’’ cover up to a four-week time block. Then, the 
remainder of the ’’experimental” course would be covered by the 
regular instructor, employing the ’’SMART” for student practice and 
demonstration and ’’SNAP” programmed texts in addition to the conven- 
tional lecture and laboratory methods. This increased participation 
in the teaching of the ’’experimental” courses- by the regular high 



school instructors made it possible for SOS to reduce the number of 
special instructors required. As a result, only one SOS instructor 
will be assigned to the Electronics Course. Only one will be assigned 
to the Auto-mechanics course, since it will be conducted at just 
■one location -- the Upper Bucks County Technical High School. The 
SOS Electronics instructor will divide his time during the fall term 
between the Upper Bucks County and Dobbins Schools according to the 
schedule shovrn in Table 4* He v/ill, of course, be available at 
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either school during the remainder of the school term to back up 
the regular instructor in the *’ experimental” course. In the event ‘ 

of an unforeseen time conflict whereby his services might be needed 

! 

at both schools simultaneously, he, in turn, will be backed up by 
the SOS Research Scientist.' 



Specific details concerning the Auto-mechanics overlays are 
contained in Appendix A, with Figure 1 providing an illustration 
of* the first overlay for this course. Since the first month of 
the Auto-raechanics Course is concerned with basic information and 



review of previous materials taught, the ” SMART r-SNAP” einphas is 
will begin in October and will be highlighted for approximately 
two months, with continued use being made of the methodology, as 
applicable, during the remainder of the school term. The most 
applicable course content areas include the ignition, fuel, carburetor 
and troubleshooting subject matter ' areas. Automobile body and brake 
repair, for .example,, are not particularly applicable areas for 
this methodology. 

Appendix B contains a description of the overlays for the 
Electronics Course and the systematic troubleshooting procedure 

which would be used by a student in the solution of a. problem. 

1 

For this procedure, overlays #1 and #5. would be used, as depicted 
in Figures 2 and 3? respectively. 

The troubleshooting procedure is based upon an analysis of 
the system and circuitry under consideration. The system is divided 
into functional groups (those components which act together to 
perform a specific function). . * 




\ 



■i 



I 









Inherent in the Cue-Response analysis is the identification 
and specification of the functions such groups perform. When the ' 
details of circuit functions are comprehended, the groups of parts 

j 

which produce the functions are represented by a block diagram, as 
used on the overlays. Such a block diagram depicts the data flow 
from one block (group of parts) to others, and thereby makes explicit 
the functional relationships and dependencies existing among the 
blocks in the system. The technical story, based on -an under- 
standing of system operation, is written into the programmed 
* instruction SNAP texts, and provides such detail as to convey 
process and purpose of the blocks. Such detail would include why 
the circuit is needed, which signals the circuit requires, what 
type of conversion is performed upon the signals and to which other 

circuits the outputs are directed. 

Once the knovrledge of circuit dependencies, functions, pur- 
poses, data paths, inputs and outputs have been developed, it is then 
possible to generate malfunctions in terms of the previously defined 
structure. A part malfunctioning in a given circuit will disrupt 
the normal functioning of the circuit and produce an observable 
sign of trouble. These signs of trouble are called symptoms. 

Symptoms are derivable* in two distinct wayi^ J theoretically and 
practically. The theoretical symptoms are derived by asking what 
would result if a specific part were to fail and deducing the 
effects. Practical symptoms are derived by actually causing the 
part to fail and observing the resulting effects. Both schemes 
are being used to develop the family of malfunction problems which 

% 

■t • . • ' . 
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will accompany each overlay. The resulting body of data then 
becomes the source for problems in troubleshooting practice to 
exercise students in logically deducing the focus of trouble. By 
programming these, in the "SMART", the learning process can be 
speeded up through its design, whereby the instructor is provided 
with a bank of malfunction switches, so that he can insert a new 
problenT situation for the student to solve as soon as he finishes 
the current one. For Electronics, where there v;iTl be five 
pverlays available, over 100 different malfunction problems can 
be provided to give the student frequent and varied practice in 
troubleshooting, so that he can understand the variety of functions 
performed by electronic circuitry and the multivariant problems 
.which can arise from the selected representative sample of mal^ 
functions. 

II* Plans for the Next Quarter 

During the second quarter of this Project, 1 July - 30 Sept. , 
1966 , the complicated process of programming course materials and 
the SMAPiT v;ill continue as follows: 

(1) System and circuit analysis. . 

(2) Determination, of a representa,tive set of malfunction 
problems for each overlay. 

(3) Practical testing of the theoretically determined symptom 
patterns associated with each malfunction. 

(4) Identification of the appropriate test points with 

associated waveforms, voltages, etc. r 

(5) Translation of these symptom patterns into logic equations, 

% 

(6) Determination of the logic . circuit interconnections 
required from the logic equations. 
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(7) Writing or the wire lists for the programmed plugboards. 

* (8) • Testing each plugboard on the SMART to determine if all 

light switches are activated properly for each symptom 
pattern configuration (debugging the logic). 

(9) Drawing of the v;aveforms, voltage readings, gauge 
levels, etc. to be used for quantitative readings at 
test points 

(10) Photographing of the drawings for reduction and place- 
ment on the slide inserts. 

I (11) Retesting each malfunction svrjtch setting for each 

overlay to determine if the correct slide is projected 
at a given test point for a given malfunction. 

(12) Holepunching and silkscreening each overlay. 

(13) Writing of the technical story for the subject matter 

: including the description of the circuit functions, data 

flow, relationships and dependencies, inputs and outputs, 
malfunction sources and associated symptom patterns, 
periodic questions and answers. 

I 

:• ( l4) Drawing the necessary artv/ork to illustrate the technical 

story in a simple, but meaningful way. 

(15) Editing of the technical story to make sure the reading 
level is commensurate with the level of the student 
body who will be using the manuals. 

(16) Publication of the SNAP technical manuals and delivery 
of the SMART Trainers and associated equipment to the 
high schools. 

! (17) Final checkout of the hardware at the schools. 

- In addition to the above, it will be necessary to provide 
orientation sessions for the high school instructors prior to, or at 
the beginning, of the fall term. These will be one to two day 
sessions at each school in which they will be briefed on the Cue- 

i 

[ Response methodology, use of the SMART Trainer, content of the SNAP 
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' manuals and the precise means for maintaining control over the 
special features of the "experimental” course materials, so that 
1 students in the "control" group do not gain access to them. The 
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I equating of course content botv/een "experimental” and “control” 

I groups has, of course, already been planned with the high schools;’ 
and, it will be re-iterated as a major necessity in order to maintain 
the proper controls for the research study. 

Two half-day sessions at the .beginning of the fall term for 
each class are being set aside at each school, so that the screening 
tests — the Otis Intelligence Test, Kuder Preference Record, 

. Owens and Bennett Mechanical Comprehension Test and the. Army Beta -- 
may be administered to all the students who are participating in 
I ‘this research study. 

III. Unantic inated Problems 

I At the present time, only l4 students each are enrolled in 

y the "control" and "experimental" groups, respectively, of the 
Auto-mechanics Course at the Upper Bucks County Technical High 
School. This is less than the 20 students in each group promised 

to SOS by the school. The school principal, Mr. Ross, states, 

? * ■ 

[ however, that a number of additional students may be expected to 

enroll this summer. In addition, if plans are completed before 

i autumn to associate tv;o more academic high schools in Upper 

Bucks County, including one parochial school, v;ith the Technical 

• . 

School half-day program, then the student population in each group 
[ will be -increased to a number well in excess of the 20 planned for 
in the experimental design. 

f To assure having a large enough population to draw from, 

i discussions have been held with Mr. Harold B. Albright, Montgomery 

* 

County (Pa.) Vocational-Technical School Director ,. concerning the . 
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application of the research methodology in some of his schools. 

If, by February 1967,* it is felt that the data base is insufficient-, 
it will be possible to move into one or two of the Montgomery County 
Schools for a month and pick up some additional data in either . 
Auto-mechanics or Electronics. This will serve as backup in the 
event too small a sample results from unexpected attrition of the 
student body in any of the participating schools, and it could 
provide useful data for cross-validation purposes. - 

Due to the additional amount of logic equations v;hich need to 
"be written for the variety of malfunctions that are being programmed, 
it is evident that the additional services of a part-time logician 
will be required. In addition, the amount of typing required for 
the programmed instruction books exceeds the time availability of 
our one secretary assigned to this project. It will be necessary, 
therefore.., to have a logician assisting the present statistician- 
logician in the preparation of the equations and to hire a part- 
time typist. Every effort v/ill be made to keep the costs of the 
three programmers limited, so that the total costs in the personnel 
expenditure category may remain the same as originally predicted in 
the Contract. 
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APPENDIX A 



'Two overlays for the SMART Trainer will be used in teaching 
the Auto-mechanics Course. In laying out the overlays, an attempt 
is being made to organize them by functional circuit. It is very 
difficult to isolante an automotive system into clear-cut circuits, 
due to the many interactions and functional relationships that must 
be performed during each phase of ' operation. For example, during 
the cranlclng sequence, the starter/ignition switch, commonly used 

■ on most automobiles, must actuate the starter, turn on the ignition 
and furnish power to the various indicators and accessories. Each 

■ of these functions are connected into the storage battery for power, 
yet are in separate functional circuits. This makes it difiicult 
to determine what the first sequence should be. To further com- 
plicate matters, carburetion must occur during crank5.ng and starting. 
Therefore, it was necessary to assign functions in the most logical 
sequence. On both overlays, the sequence will be in the following . 
order: (1) starter/ignition, (2) cranking circuit, ( 3 ) ignition, 
circuit, (4) carburetion, (5) charging circuit and followed by 

(6) the normal running performance sequence. 

Figure 1 is a copy of an overlay to be used as a part of 
the Auto-mechanics Course. This is an overall layout for the 
ignition, carburetion and related systems. Most of the functional 
components of the two systems are contained' on this overlay, so it 
should be able to provide the necessary informaulon for, learning 
system functional relationships, thus supplementing the programmed 

text. 

This particular overlay will have a total of '66 switches 
.energized-, twenty five of these switches will be for replacement. 
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repair or adjustment of the 2? malfunctions that can be injected ^ 

^ into the system at the direction of the instructor.. Associated with 
these malfunctions will be a series of 33 slides containing informa- 
tion, either for repair or for an indication on hov; to proceed to 

I the next series. | 

The students will be given a very brief indoctrination by 
the instructor on the operation of the SMART Trainer. This ■will I 

; be given to them as a group, thus, saving considerable instructor 

t” i 

\ ' time and will be accomplished prior to student practice on the ^ 

SMART Trainer. It- is currently planned that the overall layout 
^ will be phased into the course immediately after selected elements 

of theory and text materials have been presented to the group. | 

I * i 

• This should occur about mid-semester, or just prior to the j 

;* diagnostic and troubleshooting portions of the course. . i 

I ' ’ ; 

Prior to student operation of the SMART, the instructor 

i • . ^ 1 \ 

will install the proper overlay, plugboard and run a diagnostic | 

- ■ . ’ • 
test to insure proper trainer operation. Then the test must be j 

; - set up for each Individual student. In all probability the Initial „ | 

run through by the student will contain a minimum number of mal- , 

functions. So, the instructor will select the malfunctions and i j 

I • • j ^ 

energize the circuitry, reset the recording devices, then instruct i 

! i 

the student to begin the test. The following is an example as _ i ; 

• - ■ .1 

to how the trainer might be used! j 

I \ 

For the purposes of this test, all lights and indicators 
will be out prior* to operation.’ Start will be initiated by depress-^ 
ing the start - action button >^^10. The iriiicator v^ill come on ’’white 




and remain ’’white*’ indicating the phase of operation for the test. 

In addition, _starter/ignition switch indicator #35 is also ’’white” 
to indicate the next step in the sequence. The student will depress 
the starter/ ignition switch button. If there is a programmed mal- 
function, the indicator will be ’’red.” The student will thus need 
more information, so he will have to depress the button along v^ith 
the test A button to the right of the overlay. Information will 
appear on a screen located just above the overlay. In this par- 
ticular case, the slide information will direct the dudent to replace 
% 

the defective starter/lgnition sv^itch. This will -be accomplished 
by depressing the starter/ignition switch replace button. Indica- 
tors #25 and 35 will turn ’’green” to indicate the malfunction has 
been corrected. In addition, the cran king' circui t indicator #3^f 
will turn ’’white” to indicate the next sequence. Had there been no 
malfunction programmed into the starter/ignition switch, indica- 
tor #35 would have turned ’’green”, and at the same time, #3k would 
have turned ’’white” to indicate the next sequence. 

For illustrative purposes, let us say that a cranlcing motor 

malfunction has been programmed into the machine by the instructor. 

The student would depress the cranking circu it button. Indicator #34 

would turn ’’red” to indicate a malfunction in the circuit. In 
% 

addition, the indicators for the functional components in the 
STARTING circuit (indicators #43 , 44 , 53 and 54) would turn ”v;hite.” 
However, more information is desirable so the student would depress 
the cranlcing ciiicult button and test A button on the right. Informa- 
tion V7ould then appear on the screen. To proceed, the student would 






depress the battery button //43, which would turn “green." Then the 
battery cable button #53 will also appear green, so the student will 
know that there is power to the cranking motor solenoid switch. This 
would be depressed next (button #44) and- the indicator would then 
turn "green." The last "white" indicator would be #54. When 
button #54 would be depressed, the indicator would turn "red." 

More information v;ould be desired; so the student probably would 
then depress the cranking motor button and test button A. Informa- 
Jtion would appear on the screen, which would tell the student to 
replace a shorted out cranlcing motor. This is accomplished by 
depressing the cranl{:ing motor replace button #64. Indicators #54, 

• 64 and 34 and 10 will then turn "green" to Indicate that cranking 

action has been achieved. In order to proceed into the next phase 
of operation, the start - idle and ignition circuit Indicators #20 
and 36 will turn "white." The same type of logical sequence would 
follow. Thus at the end of the test, all of the phase of operation 
indicators (#10, 20 and 30) would be "green"; and, in addition, the 
remainder will either be "out," to indicate non-use for the test, or 
"green." At this time, the instructor will be required to document 
the automatically recorded data and set up the machine for the 
next student by depressing the appropriate buttons. 
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The five overlays^for the "SMABT" Trainer are as follows: 

Ovorlav #1 : A block diagram depicting the complete television 

system. 

Ovorlav #2 : A schematic diagram describing each component 

in the tuner, I.F., Detector, Video, C.R.T., A.G.C. and low voltage 
circuitries. The function of these individual circuits are as 
follows: The antenna-tune" -circuit selects, detects, generates and 

mixes different frequencies and produces an intermediate frequency 
called "I.F." The amplifier amplifies these frequencies. The 
detector extracts the intelligence from the I.F. carrier. The video 
amplifier amplifies the video intelligence uniformly. Next the 
video intelligence is changed into visual information by the C.R.T., . 
circuitry and then reproduced on the screen. The automatic gain 
control, called "A.G.C." circuit, keeps the picture at a constant 
level. The low voltage supply changes the house (A.C.) voltage to 
Direct Current (D.C.) so that it can be used to energize all circuits. 

Overlay It shows a block diagram of the video amp., and 

C.R.T. The schematic diagram shows the components in the sound 
circuitries. The limiter purpose is to eliminate all amplitude 
distortion or variation in the F.M. signal. The Ratio Detector con- 
verts the frequency-modulated (F.M,) signal into equivalent sound 
signals. -The sound amplifier amplifies the sound to a level where 
it can be reproduced by the sound output speaker. 

Overlay #4 : This shows a block diagram of video amp. and C.R.T. 

It displays .a schematic diagram of the sync, clipper, vertical 
oscillator, vertical output and vertical section of ohe yoke. The 
sync clipper separates the sync pulses from the rest of the video 








signal and these sync pulses are used to synchronize the T.V. set 
to the transmitter. The vertical oscillator generates a saw-tooth 
voltage (and current) wave. The vertical output amplifies the 



saw-tooth wave and the vertical section of the yoke produces electro- 
magnetic deflection in step with the saw-tooth wave. 

Overl ay ^5^ ? It shows a Block diagram of the Video amplifier} 
C.R.T. and sync clipper circuitries. Also shov/n are a schematic 
diagram of the A.F.C. ^ horizontal oscillator} horizontal output} 
damper} high voltage rectifier and horizontal yoke section. The 
Automatic Frequency Control (A.F.C.) maintains automatically the 
Horizontal oscillator frequency to a desired value. The Horizontal 
oscillator generates a saw-tooth voltage and is amplified by the 
Horizontal output stage which in turn is fed to the Horizontal yoke 
section. The damper circuit prevents any transient oscillation from 
being set up in the deflection coils. The high voltage (H.V.) supply 
supplies the voltage to the C.R.T. anode. 




Example of Troubleshooting Procedure : If Overlay #1 were to be 

used} and a V.H.F. or U.H.F. signal were the input signal} the signal 
flow could be traced from the antenna block to the various other 
blocks. At any block, ’a malfunction or several malfunctions could 
be programmed. 

Suppose the instructor Inserted a prcgramiued malfunction which 
was "No H.V." The first step would be to depress the M-PJZ 
An indication that the tubes were lighting would be presented by all 
blocks lighting "white." This would only mean that the filaments of ' 
the tubes v'cre lightj.ng and not necessarily functioning. Nextj if 






the sound for the picture is present would be determined by depress- 
ing the V O lume control block button. Note thut 3,11 the sound bj.pcks 
yould turn *’greenj’* which would indicute t1.3t the SDund circuitries 

I ' . 

vrere functioning. To determine if the p.o ure is present, the 
brightne^i . block button would be depressed, and noting that nothing 
jjQ^pp 0 ns , the student would know the C.R.-L. circuit is not lunctioning. 
He would probably ask himself, "Is there a video signal present?" 



This would be determined by depressing the co ntrast bl^^ button, 

which energizes all the blocks from the antenna through the video 
% 

amplifier, indicating that video is present. By a trial and error 
method, eventually the bad component could be fomd; however, this is 
■ a long dra\- 7 n out and costly job. Furthermore, our methodology teaches 
the student to proceed in a logical, systematical way. 

Now, let us summarize the course of events to this points It 

I 

has been determined that there is no picture on the C.R.T. because of 
the lack of illumination of the G.R.T. So far, the signal has been 



traced to the C.R.T. by use of lights on the SMART Trainer. With a 
real T.V. set, the speaker would produce the sound after the volume 
was turned up, and the C.R.T. would produce no light, even after tne 
brightness control was turned up. Indicating picture trouble. As has 
been illustrated here, ho test equipment has been used up to this 
point. A well-trained T.V. technician could isolate most malfunctions 
without the use. of test equipment down to the troubled circuitry. 

Since the C.R.T. in this example hasn't any brightness, a volt meter 
can be employed for use here. By depressing the volt nieter button 
and the C.R.T. testj it can be determined if there is proper bias on 
the cathode-grid of the C.R.T., or if thorij is proper H.V. on the 



C.R.T.' anode, oi* if there Is proper screen grid voltage. The volt 
meter shows that the voltage on the anode Is. low (H.V.) This tells 
us that the malfunction might be in the Horizontal, Damper or H.V. 
Circuitry, and, this check will eliminate the need for checking the 
sync clipper, A.G.C. and vertical circuitries; but, it will not 
eliminate the fact that the trouble might be in the low voltage supply 
block. A quick check with -the volt meter button and the low yolta^ 
check p_oJLnt button would reveal that the low voltage supply block was 
functioning. Since it would have been determined that the trouble 
might be in the Horizontal, Damper or H.V. circuitries, and assuming 
that the technician had checked all tubes first fJid had determined 
that none were bad, he would proceed by checking the Horizontal, 
Damper and H.V. circuits, respectively, by depressing each button 
relltive to signal flow. When the troubled circuitry was located, 
it would light "red"; which, in this case, the HorizMital ojrtjrut 

circ~glt would do« 

Now, Overlay #5, which is the Horizontal, Damper and H.V. 
schematic diagram drawing, would be instal.led in place of the Bled, 
diagram of Overhy #1. With this type of d< tailed Overlay, the indi- 
vidual components could be checked; and tV.e student would find that 
the Horizontal output circuit contained the malfunction. With use 
of the various test equipments-- voltage, resistance or Scope, by 
depressing the associated test button and one of the test Instrument 
buttons, individual components or points ;.n the circuitry could be 
evaluated. With reference to Overlay #5, R 23j a IK 2-Watt 
resistor would be .found to be opened. By depressing the volt meter 
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Sind th6 cii0ck button that is rolatod to tho scroon grid of* tho 
horizontal output tube, the studcrl: vfould note that no voltage is 
present on the screen grid of this tube. This component could be 
checked with an Ohminetcr to determine if it is opened, which, in this 
case, it would be. By depressing the repla ce button, the "red” lights 
would turn "green" telling the student that the set had been repaired 
and was nov7 back in proper operation. 
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TABLE 1 

MEETINGS MELD DURING. PROJECT FIRST QUARTER 



Date Conferee Location 



April 7-8 


Dr. E. L. Shriver, Consultant 


Washington, D. C. 




19 


Messrs. Ross, Moyer, Keim 


Upper Bucks Tech. H.S 


% 


22 


Messrs. Magliocco, Schecter, 
Johnson 


Dobbins Tech. H.S. 


May 


3 


Messrs. Ross, Moyer, Keim 


Upper Bucks Tech. H.S 




17 


Dr. Sidney C. High,'J. J.Maimone 


USOE, Washington, D. < 




18 


Dr. E. L. Shriver, Consultant 


Washington, D. C. 




19 


FOREC AST “L ORAN Course Instruc- 
tors 


USNFTA 
Norfolk, Va. 




27 


Messrs. Donovan, Magliocco, 
Schecter, Johnson 


Dobbins Tech. H.S. 


June 


2 


Dr. E. L. Shriver, Consultant 


King of Prussia, Pa‘. 




7 


Messrs. Ross, Moyer, Keim 


Upper Bucks Tech. H.S 




16 


Dr. E. L. Shriver, Consultant 


Washington, D. C. 




23 


Dr. Sidney C. High, J. J.Maimone 


USOE, Washington, D. i 




24 


• 

Dr. E. L. Shriver, Consultant 


V/ashington, D. C. 
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Note ; Only the Upper Bucks County Technical High School is involved in this course. 
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TABLE 7 



Course Ou tJlnp 



The -Ignition System 



(Time AlloccJ'.ion - Classroom, 5 hours) 



A. Theory ^ ^ , 

1. Operation of the foiu^ cycle engino-Rcvlew 

2. Functional description of the ignition system 

a. Primary circuity 

b. Secondary circuit 

3. Ignition coil 

a. Description and fuhctilon 

b. Ballast resistor or v;lrc resistor 

4. Ignition distributor 

a. Contact points 

Cam angle 

(2) Gapping 

b. Condenser 

c. Distributor cap and rotor 

d. Automatic spark control mechanism 

(1) Centrifugal 

(2) Vacuum 

(3) Combination 

(4) s park control curve 

e. High tension v/ires 

f. Spark plugs 

. (1) Cleaning or replacement 
(2) Gapping 

g. Special ignition systems and devices 



B« Practical (Time Allocation Shop, 15^ houis) 

1. Distributor overhaul 

2. Coil testing procedures ' 

3. Spark plug servicing 

4. Engine timing 

5. Secondary v;iring 



Fuels and Fuel System (Time Allocation ~ Classroom, 1? hours) 
A. Theory 

1. Purpose of fuel system 

2. Component part of fuel system 

a. Fuel tank 

( 1 ) C ons true t i on 

(2) Venting 

b. Fuel gauges 

( 1) Balance coil 

(2) Thermostatic 

c. Fuel filter and screens 

(1) In-line 

(2) Carburetor filter 

(3) Fue 1 pump • 


















d. 



c. 



3 . 



4 . 



Fuel pump (description and purpose) 

(1) RocKer arm 

(2) Diaphram 

(3) Inlet valve 

(4) Filter and screen. 

( 5 ) Outlet 

(6) Operation 

Carburetor (description and purpose) 

(1) Air horn 

(2) Venturi 

(3) Btiel nozzle 

(4) Throttle valve 
Air cleaner 
• ( 1) Purpose 

(2) Care and servicing 
Intake manifold • 

Fuel pump operation 
a. Types 

(1) Single . action 

(2) Electric 

(3) Combination~fue3. and vacuum 
Carburetor operation 



f. 



g 



a 



b. 



Purpose 

(1) Metering 

(2) Atomization 

(3) Distribution 
Fundamentals 

(1) Air/fuel ratio 



(2) Flov^ curve-air flow vs. air/fuel ratio 



c. 



d. 



5 . 



(3) Flow curve-carburetor systems 
per hour 
Principles 

(1) Vacuum 

(2) Venturi 
Basic systems 

(1) Float 

(2) Idle system 

(3) Main metering system 

(4) Power system 

( 5 ) Pump system 

(6) Choke system 
e. Auxiliary system 

U) Vacuum spark advance 
Fuel system troubleshooting 



vs. miles 



b. 



Performance analysis-carburetor 

(1) Flow curve-air flov; vs. air/fuel ratio 

(2) Flow curve-curburetor system.s vs. miles 
per hour 

Performance analysis-fuel piimp 

(1) Pressure 

(2) Capacity 

(3) Vacuum' choke 

(4) Servicing 
Air cleaner 



( 1 ) 

(?) 



Test 



Bervi n1 UP 




iHi 












f 



- 3 - 



i 



p 



B. Practica]. (Time Allocation - Shop.) 45 hours) 

1. Tank checks and repair methods j 

2. Fuel pump 

a. Test : 

b. Overhaul i 

3. Carburetor (Rochester) 

a. Complete overhaul i 

(1) Single barrel 

(2) Tv/o Barrel 

(3) Four barrel 

(4) Corvair model carburetor 

b. Adjustment 

(1) Choke 

(2) Idle 

(3) Pump rod j 

(4) Un loader | 

4. Air cleaner-test 

5. Fuel system test and diagnosis j j 

a. Pump pressure and capacity test ! ! 

b. Air cleaner test ! j 

c. Combustion analyzer 




Engine Analysis and Tunc -up (Time Al l oca 
A. Emergency troubleshooting 

1. Basic starting troubleshooting 



tion - 
tests 



Classroom & Shop 4o 

hours) 



r 

f. 



B. Detailed tests for hard startin':^ 

1. Cranking system 

2. Ignition system 

3. Fuel system 




Tune 

i. 



2 . 



up procedures 

Types of test equipment used 

a. Compression tester 

b. Tachometer 

c. Dwell meter 

d. Exhaust analysis 

e. Vacuum, gauge 

f. Voltmeter 
Procedures 

a« Battery and battery cable 

b. Cranking circuit 

c. Charging circuit 

d. Ignition circuit 

(1) Primary 

(2) Secondary 

e« Fuel and carburetor 



f. . Compression 

g. Spark plugs 

h. Road test 
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Generator Generator 
Repair/ 

Test D 



Replace 
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Regulator Cut-Out 
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Replace 
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Test D 
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Vacuiim-CentCondenser Ignition 
Spark Adv Points 

Repair Replace Replace 
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Spark Adv 

•Test E Test B Test B 




[22 
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Light 
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Replace Test 3 



Coil 




Fuse& Cir Lights & 
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Rotor 
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Rotor 

Test B 




Coil 

Replace 
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Charg|.ng Cranking Starter/ Ignition Carburetiori 



Sr.eakers Apcessories Circuit Circuit Ignition Circuit Circuit C 
^ I Test D • Test A Switch Test B Test C CIf 
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Light 
Switch 
Test F 



Battery 
Recharge or 
iHe place 
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Dimmer 
Switch 
Test F 




Test 
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Battery 

Test A 




Test A 
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Solenoid 
Switch 
Test A 



Accessories Battery 
I Cable. 
Test F Test A 



Cel 




Cranking 
Motor 
Test A 



Switch 

Test A — ^ 

© © 

Solenoid Fuel Tank Fuel Tank 
Sv;itch <S: Supply & Supply C 
Repair or Repair or Test C 
"" Replace Replace 

© ® © 

Temp. 

Gauge 
Test E 
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Oil Press, Fuel Fue 
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Test E Rep 
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Headlights Lights Battery Cranking Temp. Oil Press. 
Tail light, Acces. Cables Motor Gauge Gauge 

Replace Clean or Rep Repair Check/Rep. Check/Rep 



Fue 

Fi 

T. 



^€ure 1 . Automotive - Overall Block Diagram 




0 © © 

Rotor DifJtributor Spark 

Cap Plugs- 

R6plc«.^c; Rcrplaco ReplacG 



0 © 



Jest B 




Rotor Distributor Spark 



Cap 
Test B 



Plugs 
Test B 





Coil 

Replace 



Intake 

Manifold 




.7J 






irburetion Air High Speed 
Circuit Cleaner Power Cir. 
Jest C Cipnn or 

itc; _dce 




jiel Tank Air 

( Supply Cleaner 
I Test C Test E 



I 0 © 

I Fuel Fuel Lines 
[idicatorFi Iters 
I Repair or 

* Replace 

(6^' 

Fuel Lines 
Filters 

Test C 



Test E 

© 

Automatic 
Choke 
Test C 




|sTARTh p> 



0 



Starter- 

Action 




Start* 

Idle 




Running- 

Normal. 



© 



Carbureto 
Repair o 
Replace 




2> 

Automatic 
Choke 
Clean ^ 
Adjust 

0 

Start -Idle Carburet}) 
[Repair or 
Test C Replace 



W 

Fuel-Vac 
Pi^mp 
Test C 




0 



Fuel-Vac 
Pump* 

Reoair/RdP 



.'.•i 



un 






o 

ERIC 



O 

Test A 

O 

Test 3 

O 

Test C 

O 

Test D 

O 

Test E 

©■ 



Test F- 



p.PA I.! «j.j, idpw. -g 







I 



I 



I 

I 



♦ ‘I?*. 



SECOND QUARTERLY. REPORT 
PROJECT USOE 5-1332 




TITLE: A Study of the Effectiveness of a Military-Type 

Computer-Based Instructional System When Used 
in Civilian High School Courses in Electronics 
and Auto -mechanics • 



TO: 



rapM 






U. S. Department of Health, Education and Welfare 
Office of Education 

Division of Adult and Vocational Research 



Systems Operations Support, Inc. 

5oO Shoemaker Road 

King of Prussia, Pa. 19^6 



REPORT PERIOD; 1 July I966 — 30 Sept. I966 




; Administrative Grants Officer . 



r 















. 






TABLE OF CONTENTS 



Section 



Page 



Sec 03 id Quarterly Summary 
I. Work Completed Luring Second Quarter 
II • Plans for Next Quarter 
III. Unanticipated Problems 



O 



7 

8 






X. 

*• 



er|c 



n I T I -■ I - -II riiiiir— ■ — - iirirTi'i itn't 









SECOND QUARTERLY REPORT - USOE 5-1332 

SUMMARY ■ 

Ob.iectives s 

1. To determine the difference in performance between (a) students 
enrolled in a military-type computer-based instructional program in 
electronics and (b) students enrolled in a conventional instructional 
program in electronics, with both groups of students being drawn from 
a high school population with an I.>Q/ range from 100 to 130 (and higher). 



2. To determine the effectiveness of the milit&ry-type computer- 
based instructional program in electronics when used on a lowdr I.Q, 
range (78 to 112) group of students « 

3. To determine; the effectiveness of the military-type computer- 
based instructional system vrtien used in a different subject area: 
Auto-mechanics. 



Procedures 2 

The project utilizes a computer-based instructional system which 
has proven to be very effective in military training programs. The 
system will involve the Cue-Response programming method, ’’SNAP’' pro-* 
grammed texts and programmed overlays for the "SMART" Trainer (a universal 
simulation and representation device which can be tailored to a specific 
course merely by changing the student *s panel and plugboard, programming) . 



Course materials in two courses (Electronics and Auto-mechanics) 
have been programmed on the basis of the Cue-Response method resulting ’ 
in the production of "SNAP" programmed texts and programmed overlays for-^ 
the "SMART" .Trainer. For the Electronics Course, materials previously ^ 
used in military training programs were revised, supplemented and adapted 









wmm 



v*;?.. ■ : 

for use in civilian teclnnical high schools. For the Auto-mechanics- 

. ^ .• I ! 

^ ' ' ' 

Course- new materials .were developed specifically for this project. i 

^ • 1 

! ] 

Two vocational high schools (Dobbins Technical High School, Philadelphia^ 

’ ’ i ; 

\ ;> 

Penna. and the Upper Bucks County Technical High School, Perkasie, Penna,^ 
are the locales for the experiment). 



Accom-plishments ; 

Second quarter activity was devoted to development of the programmed 
instruction texts, submission of the materials to the equipment manu- 
facturer for incorporation into the ’’SMART” Trainer and development of 
the actual course of study for each of the two experimental course s„ 

Meetings were held with the principals, technical education directors 

: 

and instructors concerned with each of the two respective courses for 
firming up commitments and agreements made previously. 



Full day sessions for all students participating in the study at 
each school were devoted to administration '•f the Otis Intelligence Test, 
Kuder Preference Record, Bennett Mechanical Comprehension Test and the 
Army Beta. Results were tabulated and the selection of matched experi- 
mental and control groups was made for each subject matter area© 

■ ■ ^ ' 

Plans for the next quarter include final acceptance of both sets 

of overlays (Electronics and Auto -mechanics) with all malfunction problems 

associated with each one, including the programmed plugboards and slides 

• £ 

for the ’ISMART” Tra^iner. The courses of instruction at the respective 
participating high schools will begin this quarter. 


















I, Work Completed Durinrt Second Quarter : ■ *• 

Second quarter activity was a continuation and , fulfillment of most 
of the work as identified during the initial planning stage. Many 
meetings were held with the principals, technical education directors 
and the instructors for the respective courses. 

A. Electronics Course 

For the Electronics Course, frequent meetings and telephone 
conversations were held with the Project Consultant in order to 
take full advantage of his experience ^d the military electronics 

I 

course materials which were developed on past projects. Dates for 
these meetings and with the school personnel are listed in Table 1. 
All materials submitted by the Project Consultant have been received 
for content and clarity, corrected and expanded for the experimental 
course. 



Based on this information, the text "Electronic Methodology," 

s . . . 

dated 29 September 1966, was written in conformance to some of the 
"SNAP" type programmed instruction methods as developed previously 
for various military training courses. In conformance with the 
principle of utilizing the optimum approach to teaching as appro- . 
priate, the matter, reading level, type of language and the format 
have been varied between the various sections of the text. For 
example, one section on troubleshooting is ciarly a scrambled text. 
Another is very "SNAP" -like, while another section is more like an . 
infvormal text. In all cases, the texts vail serve as a means for 
introducing the student to all levels of electronics and will provide 
the necessary content for advancement up to and including logical and 
systematic troubleshooting. • 
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B. Automobile Mechanics 

Programmed information for the text ’lAuto Mechanics Methodology 
dated 1^- September 1966 was written in conformance with some of the 
selected criteria for the "SNAP" type programmed instruction books. 
Th^s text concentrates on an area of knowledge required for the com- 
petent auto mechanic — namely, logical and systematic gathering of 
symptoms, analysis of these, and a logical step-by-step methodology 
of isolation to a system, component, removal and replacement or 
direct repair of the component, and then an operational check to 
determine that the automobile will perform satisfactorily. All 

t ' 

superfluous information or checks which, are specific to a given 
make or model of car have been left to the service manuals produced 
by their respective manufacturers. 



Subject matter areas in the text include the ignition system, 
fuel system, engine analysis and tune-up procedures; e.g. those 
areas which can benefit the most from a systematic approach applicable 
generally to any problem which might arise. Other automotive skill 
areas are left to the more conventional and repetitive training 



methods and techniques. 



C. SMART Trainer , • ^ 

As planned during the initial phases of the project, five overlay 

and associated plugboards along with the appropriate sets of slides 
will be utilized for the Electronics Course. . For the Auto-mechanics 
Course, two overlays, associated plugboards and appropriate sets of. 
slides were developed for teaching trouole shooting. ^ 



t. 










During th© quarter j much of the activity was devoted to preparing 
.the specifications for the overlays, determining the sets of mal- 
function problems and establishing the appropriate information for 



detecting these malfimctions. This was accomplished and submitted, 
to the s-ub- contractor for the development and design of the seven 
respective overlays* In conjunction with this task, SOS personnel 
performed a lengthy, detailed system and circuit analysis to ensure 
that the machine would perform as specified. 

Translation of the various symptom^ pattern^ into logic equations 
was accomplished during the quarter. From these equations, the logic 
circuit interconnections were then developed and assembled as were 
lists for wiring the plugboard for the respective overlays* These 
wire lists were then sent to the sub-contractor for plugboard wiring. 
Other, activities included drawing and development of the various 
waveforms, voltage readings gauge levels and pictures of TV picture 
distortions, etc. to be used for quantitative reading at test points. 
These were completed, photographed and sent to the vendor for place- 



ment on the slide inserts. It should be noted that the photographing 

j 

of malfunction indications, €*specially on the TV screens, was a 
laborious and exacting task which had to be repeated a number of ' 
times in order to produce pictures with sufficient detail for 
reduction to the lens caps used in the optically changed random 

access slide projector. Towards the end of th© quarter, major work 

effort was being expended in preparing the »'SMART" Trainer and associ 

\ 

ted equipment for phase-in for both the auto-mechanic and. electronics 
courses. Present scheduling for the courses at both schools is shown 
liii Table ,1. 
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D. Psychological Testing. 

> * * •' 

I A full day was spent at each school on different days for the 

. * ■ • 

purpose of administering a ,pre-s.-^lected battery of tests. The bat-> 

t^ry was made up of the following standard tests: (1) evised 

Beta Examination; (2) Otis Quick-Scoring Mental Ability Test; 

(3) Bennett Mechanical Comprehension Test, Form AA; and (4) The 

■ • 4T 

Kuder Preference Recoil (Vocational) Form CH. All students wlo 
will participate in the research study were ^tested. Scoring and 
analysis of the test results is currently in progress. Very quick 
look summaries of the test results are shown in Tables 2 and 3. 

Preliminary analysis of the information for the Auto -mechanics 
students tested on 20 September 1966 at the Upper Bucks County 
Technical High School produced the following results: (1) The 

age range of the group was 15 to 19 years; (2) the 10-12th grades 
were involved; (3) Otis I«Q. scores ranges Irom 7^ to ll4. As for 
. the Upper Bucks Electronics students ,• the data came out as follows: 
(1) Chronologicla age ranged from l4 to 17 years; (2) the 10-12th 
grades were also involved; and (3) Otis IoQ« scores ranged from 85 
to 130. 



On the 27th of September I966 the same battery of tests was aql- 

■ • . ' 

ministered to the Electronics students at the Dobbins Technical High.; 

i 

While both the 11th and 12th Grade strident s were tested, since the 

• • * * 

12th Grade will be receiving the experimental course of instruction 

« 

first, the results on it are available to date only and are as follow 









(1) Ages 16 to. 18 years, inclusive, const itite the chrono t/'>;:lcal aj;or: 

(2) bhe Otis I.Q. scores range from 92 to 131. Exferxraontal and 
control groups were selected from this population by meaL(.s ol pali 'iir 
from a rank order of test scores. Additional data about tbe two gtvjn 



may be found in Table 2. 

II. Plans for the Next Quarter, 

During the third quarter of this project, from 1 October to -31 
December I 966 , it is planned that the majority of the data will be | 
collected from actual administration of the experimental method, the | 
SMART/SNAP approach, to the students in the ElActronics and Auto- | 
mechanics courses. Specific events which are planned for this period 

are as follows: 

(1) Completion of the debugging of the SMART plugboards to see 
that all light switches are properly activated for each malfunction 
symptom pattern configuration, (debugging the logic) 

(2) Completion of slide inserts and testing of locations to see 
that the appropriate slide shows when a given test point and test 
equipni®^t switch match is made. 

(3) Final acceptance tests of the SMART trainers and ^ their deliT 

very to the two participating high schools. 

(4) Final checkout of the trainers after delivery to 13® schools. | 

(5) Initiation and completion of the’ course of instruction for 



Auto-mechanics at Upper Bucks (See Table ' 

•(6) Initiation and completion of the Electronics courses at 
Upper Bucks and the 12th Grade at Dobbins ( 11th Grade will come 
in the final quarter in January) ' 

- 7 “ 














(7) Continuation of the analysis of test results. 

(8) Compilation of the test results, analysis and preliminary draft 

in preparation for the final research repo>?t. This will include 
tests for the significance of the difference in performance of the' 
experimental and control groups for each course on end-of-course 
(experimental run) proficiency examinations . ^ • 

III. ITnanticinated P- oblems. 

(1) As identified in the First Quarterly Report,, the Auto-mechanics 
course at Upper Bucks had only 10 students in Jihe experimental group 
and i4 in the control group. Unfortunately, the Bucks County School 
System did not increase their number by sending additional students 
there from other Academic High Schools as originally expected by this 

autiunric 

(2) A m.imber of minor budget adjustments were required as .reported to 

you in a letter dated 21 September 1966. Concurrence by letter on th 
changes is still requested. . 

(3) Debugging of the programs has taken longer than anticipated; 
howeve;.% in the final analysis, delay in the delivery of the SMART 
^rainers after the second quarter was caused primarily by the tardinej 

I 

of the hardware vendors to supply vitafk parts such as the luicroswitch' 
lights, silkscreens for the overlays, and the slide pictures mounted j 
optically aligned, (Nevertheless, since the two SMARTS were not deli- 

vered on or before 15 Octo’^er 1966, as specified in the contract, thi: 

♦ 

delay in delivery of these leased items caused SOS staff personnel to 
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ai»oiui many adaiUonal iion.ias iiuUti ni^: ^la.'V.i a i.on:i Xu ihofiiiMviru ! urn 
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* * • 
the course content so as to allow for troubleshooting training on l.ho 

i • ^ 

SMARTS at the end of thecourses. 

I 

(4i The manufacturer sent SOS a letter on 12 September 1966 and 
made numerous telephone calls ■ requesting an additional $90Q»00 io- 
making up one more set of slides than originally projected for 
Electronics cuurse. This would require additional contract funds; 

I 

and the matter id being referred to Area 1 Contracts and Construction 

t * . 

Services for their consideration, 

(5) Since the statistician- logician costs are now approximately 50 % 
over the $l^i00,00 estimated, and final logic changes i:iay rtill be 
made as unexpected malfunctions arise in the SMART programs^'; i *• is do! 
that personnel costs are at the point where there is just enough left 

to carry through tte key personnel scheduled on the project for the 
remainder of the study. There has ‘nev6r been any slack in any other, 
chtegory than personnel; as a matter of fact, cost items such as Irave 

* ' ■ 4 I 

and Benefits, especially ^surance, keep surpassing the anticipate 
amounts each quarter to the point that it will be difficult to meet 

the the estimates and not overrun in these categories before th§ end 

* • ‘ * 

of the Grant, . ’ . 

* 

(6) It is felt that the effectiveness of the methodology should have 
more time to be- administered than is presently being allocated by the 



schools; a follow-on study to complete this work with more students. 



especially naive ones in the subject matter area at the 10th grade^ | 
level should be made. The methofiology may prove to be more effec« 5 .ive 
^i^th naive students than with those contaminated with the donvenoioiial 
methods of technical training in a given subject matter area. * -r 

V # - 
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wg. 10 
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19 

29-31 



Sept, 
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2-4 

13 
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27 
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and Johnson 



Dobbins Tech. H. S. , Phila, 
Dr. E. L. Shrivel*, Consultant Washington, D. C. 

Mr. George Young, NAES Sicklerville, N. J. 

Dr. E. L. Shrlver, Consultant Washington, D. C. 



Dri E. L.Shriver, Consultant 
APA Convention 
Testing and Conference 
Mr. George Young, NAES 
Testing and Conference 
Testing 

br. E. L. Shriver, Consultant 



Washington, D. C. 
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Based on the Otis Intelligence Test Administered on 20 September 1966 




Note ; Only the Upper Bucks County Technical High School is involved in this* course 
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THIRD QUARTERLY REPORT - USOE 5-1332 



SUMMARY 



OBJECTIVES ; v 

1. To determine the difference in performance between 
(a) students enrolled in a military- type computer-based instruc- 
tional program in electronics and (b) students enrolled in a con- 

•* • • • 

ventional instructional program in electronics, with both groups 
of students being drawn from a high school population with an 
I.Q. range from 100 to 130 (and higher). 



2. To determine the effectiveness of the military- type 
computer-based Instructional program in electronics when used on 
a lower I.Q, range (78 to 112) group of students. 



3, To determine the effectiveness of the military-type 
computer-based instructional system when used in a different 
subject area: Auto-mechanics, 



PROCEDURES; 



The project utilizes a computer-based instructional system 
which has proven to be very effective in military training 
programs. The system will involve the Cue-Response programming 
method, ’’SNAP” programmed t§xts iid programmed overlays for the 
’’SMART” Trainer (^,ja-^iversal simulation and representation device, 
which c^a-b^ tailored to a specific course merely by changing the 
Kent’s panel and plugboard programming). 






















Luijiiijmiuijii fillip 



Course materials in two courses (Electronics and Auto- 

i.' . • . 

i mecihanics) have been programmed on the. basis of the Cue-Response 

method resulting in the production of "SNAP" programmed texts and . 
programmed overlays for the "SMART" Trainer. For the Electronics 
f Course ^ materials previously used ,ln military training programs 

41 ^ 

[ were revised ^ supplemented and adapted for use in civilian 

technical high schools. For the Auto-mechanics Course, new 
materials were developed specifically for this project. Two 
[. vocational high schools (Dobbins Technical High School, Philadel- 

I . phia, Penna. and the Upper Bucks County Technical High School, 
Perkasie, Penna.) were the locales chosen for the experiment. 

In addition, the Electronics Course will be presented at the 
[ Montgomery County Area Vocational-Technical High School in 

January and February 1967 • 



AHCOMPLISHMENTS ; 

Third Quarter activity was devoted to finalizing the course 
material for each of the respective courses, submission of 
technical information to equipment manufacturer for incorporation 
into the "SMART" Trainer and the conduct of the instructional 
program in the two technical high schools. 



A. third school, the Montgomery County Vocational-Technical 
High School, has agreed to cooperate in the study for the Elec- 
tronics Course for a four-week period starting in January 1967* 
Students participating in the study have been administered the 
Otis Mental Ability Test, Bennett Mechanical Comprehension Test, 




- 2 - 















I 



‘X 






r . 



f 









• Ruder Preference Record and the Revised Beta Examination. Results 

i ■ •* 

are now being tabulated for inclusion in the final evaluation^ 



The "SMART” Trainer was delivered to the Upper Bucks County 



Technical High School for use in the Auto-mechanics Course. 



Plans for the Fourth Quarter include completion of courses 
of instruction in the respective participating high schools, 

conducting the Electronics Course of instruction in the third 

» 

high school (Montgomery Coimty) , tabulation and statistical 
evaluation of the results of the study and writing and submission 
of the Final Report. If, time permits, the "SMART" Trainer will be 
sent to Dobbins Technical High School during February to collect 
additional data on its impact on the student population there. 

Due to the difficulties mentioned in the section on "Unanticipated 
Problems," it was not possible to use it there during October and 
early November. 



lo Work Completed During Third Quarter; 

Third Quarter activity was a continuation and actual fulfillment 
of most of the work that had been outlined during the initial planning 
stage. Many meetings were held with the principals, technical 
education directors and the instructors for the respective courses. 



A. Electronics Course — 



The first part of the Quarter was. spent in finalizing and 

% 

printing the instructional materials prior to the initial . 
teaching phase at Dobbins Technical High School. A series of 
student handouts, such as* a detailed description of the ohmmeter. 



- 3 - 










I 








% 



'i ‘ 




I 

I 



I 

{ 



t 

t. 

h- 

r. 

L 

I • 

i. 

4 ■ 

y- 

t 



i 

i 

i 



necessary to supplement the programmed text were prepared. 
Another series titled TV Tips, which is a series of practice 
exercises to be filled out by the student during the covurse 
of instruction, was prepared. In addition, a series of lecture . 
materials based on the information received from the Project 
Consultant was reviewed, corrected and reproduced for use 
by the instructor during the teaching phase. 

The instructional phase started at Dobbins Technical High 
School in October and was finished on 25 November I 966 . 
Experimental and control groups were selected from the 
12th grade student body by means of pairing from a rank order 
of the test scores obtained from the Otis Quick-Scoring Mental 
Ability Test. The SOS instructor assumed the responsibility 
for the conduct of the experimental course during this phase. 

The control group was handled by the regular instructor who 
taught the same materials utilizing the conventional method. 
Unfortunately, due to a delay in hardware delivery, the "SMART" 
Trainer was not available for use by the students in the experi- 
mental course. Data was collected on the two groups, including 
a final grade and it should provide meaningful evidence for 
evaluation of the two distinct methods of presenting technical 
information, including the "SNAP" programmed instruction method 
but without use of the Trainer. 

The instructional phase of the study for the Upper Bucks 
County School started on 29 November I 966 . It was still in * • 
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progress at the end of the Quarter. Data is being collected 
and tabulated for the final analysis and evaluation. 

B. Automobile-Mechanics — 

The first month of the Quarter was spent in development 

% 

of the special training aids, instructor guides and familiar- 
ization by the instructor of the materials contained in the 
programmed text. A special handbook to be provided each 
student entitled "Diagnostic Guide and Handbook" was developed 
and reproduced. This information supplements the programmed 
text and was utilized during the Engine Analysis and T\me-up 
portion of the course. 

The Auto -mechanics Course started on 10 October and fan 
until 22 December I966. Essentially, the course was divided 
into three distinct areas and was taught in the following 
sequence: Ignition System; Carburetors and Carburetion; and 
Engine Analysis and Tune-up. The "SMART" Trainer was phased 
into the course on 1 December as planned. This was the period 
when Engine Analysis was being taught to the group. The control 
group was being exposed to similar information using the 
conventional teaching methods and aids at a different time 
period (afternoon class). At the completion of the course, 
a final examination was. administered to both groups. This 
information has been tabulated and is now being evaluated. ' 
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i . C. SMART Trainer — , ' 

During the initial planning and preparation of course 

i materials, two overlays and associated equipment were to be 
included for troubleshooting of auto systems on the "SMART” 

Trainer. Similarly, a series of five, overlays and associated ; 

I 

equipment were to be included in the Electronics Course. s 

Early in the Quarter, it became apparent that the trainers . ' 

were not going to be delivered by 15 October, as originally ^ | 
scheduled. This tardiness on the. part of the manufacturer 
was due to late delivery of vital parts for the SMART, 
especially the microswitch lights and acceptable slide ^ 

pictures. SOS personnel started making revisions to the 
basic curriculum, shifting the trainer application to the 
later portions of the courses. This was not enough, as ^ 

unanticipated debugging problems were greater than expected. 

As a result, only one of , the Auto -mechanics overlays was 
delivered to the school for use during the Quarter for use 
• by the experimental group. As for Electronics, major diffi- 

I 

culties in logic developed when it was discovered that the 
correctly-functioning components represented for training 
purposes were not lighting green during malfunction problems. 
Rectification of these errors continued to the end of the Quarter. 

To assure having a large enough population for the Elec- 

% 

tronics Course, discussions were held with Mr. Harold B. Albright-, 
Montgomery County, Pa. Vocation-Technical School Director, con- 
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cerning the application of the research methodology in one 

• > 

# 

of his schools. As a result of these discussions, confirmation 
was received on 2 December I966 from Mr. Harry P. Reddig, the 
principal of the Montgomery County Area III Technical High 
School expressing an interest in the study and agreeing to 
permit SOS to conduct the study for the afternoon Electronics 
class. The experimental course will be given to this group 
starting about the first week in January. This group will be 
utilized to collect the data needed for the complete evaluation 
of the SMART/SNAP Methodology in Electronics training. Further- 
more, depending upon the outcome of the request to USOE for 
additional funds to cover the unanticipated problem cost 
areas , an attempt will be made to return with the Trainer to 
the Dobbins Technical High School during February 1967 to 
complete the data collection there. 
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D. Psychological Testing — 

Two half days were spent at the Montgomery County Vocational- 
Technical High School for administering the pre-selected battery 
of tests to the afternoon Electronics class (experimental group) . 
The battery consisted of the following standard tests: 

(1) Revised Beta Examination; (2) Otis Quick-Scoring Mental 
Ability Test; (3) Bennett Mechanical Comprehension Test, 

Form AA; and (4) the Kuder Preference Record (Vocational) 

Form CH. Results of the tests are now being analyzed. Pre- • 
liminary results are as follows: (1) the age range of the group 
of 20 students is 1? to I9 years; (2) the 10th to 12th grades 












were involvedj (3) Otis I»Q« scores rauiged from 95 "to 122« 

0 

The remaining information is not available at this time, as 

\ 

it is still being processed. 



II. Plans For The Fourth Quarter : 

m 

A major portion of the experimental data was collected during 
the Third Quarter. Spe.cific events planned for the Fourth Quarter 
are as follows: 



A. Completion of the Electronics Course at the Upper Bucks 
Technical High School. 

B. Initiation and completion of the Electronics Course at 
the Montgomery County Vocational-Technical High School. 

C. Possible return to Dobbins with the "SMART*' Trainer and 



all the Electronics overlays .to complete the collection of 



data there . 



D. Continuation of the analysis of test results. 

E. Compilation, statistical analysis, and interpretation of 
test results. 



F. Write-up, publication and submission of the Final Report ' 
for the study on or before 31 March 19^7 • 

G. Possible curtailment of the activities of all personnel 

assigned to this project during February 19^7 j except for the 

% 

Principal Investigator and the Secretary, due to the impact 
of the increased costs as stated in letters to USOE on 
21 November I 966 and 9 December I 966 , respectively. 
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in. TTnantlelpg t.ed Problems: 

' The major difficulties experienced during this Quarter 
coiicerned the impact of delays in the preparation of trainer 
ma-Jerlals such as slides and the logic development which held 
up the delivery of useable overlays and plugboards with accompany;- 
ing slides for the Electronics Course through most of this period. 

The lengthy debugging process which uncovered the fact that 
properly functioning components were not lighting green during 
the malfunction problems necessitated a major redoing of the 
logic and a corresponding rewiring of the plugboards. This 
caused considerable expense which resulted in the subcontractor 
writing a letter to SOS on 15 December 1966 in response to our 
letter to them on 6 December 1966 in which North American Elec- 
tronic Systems, Inc. requested another $7,650 even though SOS 
had asked them to cooperate in' achieving a worthwhile program in 
this research effort and to try to absorb the costs they had 
verbally estimated to SOS about 1 December 1966. Meanwhile, on 
9 December 1966, SOS sent USOE a letter stating the technical and 
cost problem areas, including insurance coverage for the equipment, 
added personnel costs for the additional logic work, and the fact 
that another set of slides would be required if the Electronics 
Courses were to be continued in two schools simultaneously. 

These problems could not be anticipated beforehand, and, as a 
result, the request was made to USOE for additional funds to carry . 
out the full intent of the research objectives in spite of the 

obstacles cited. The end result, happily, is that the SMART Trainer 

• • • * 
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in use at the Montgomery County Tetihnical High School for the 
Electronics Course is working very well to capacity; and the 
students are taking to it with a high degree of motivation, 

I 

with the learning process being expedited. On the other hand, 

SOS personnel will need to be taken off the project bn or before « 

1 March I967 because of the shortage of funds, and, unless USOE 
provides additional funds as stated by the subcontractor, it 
can be anticipated that there will be some major, financial 
difficulties to be resolved. SOS cannot, without your approval 
and appropriation of these funds, take any further action in 
this regard. 
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Mean 
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Interim Data Analysis 



Dobbins - Electronics 
Final Beta Otis B ennett 



73.14 115.18 110.18 36.18' 

9.15 7.77 9.89 5.96 



74.20 117.30 109.70 

8.85 6.81 9.82 
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t = .3719 
40 df .05 =2.021 



nnT'fl-p Bucks - Electronics 
Final Beta Otis Bennett 



69.25 

19.93 



111.16 il5.17 39.83 

6.08 7.72 7.75 



51.00 115.31 113.75 
17.37 4.28 5.52 



43.44 

7.13 



t = 2.49 

26 df .02 =2.479 



.*< 1 . 



Experimental 11=22 
Ruder (M) Ruder (C) Ruder (S) 



5.55 

1.67 



6.09 

1.53 



6.14 

1.77 



®1. 234567 = .7215 



Control H=20 



5.50 

1.72 



5.70 

1.58 



6.20 

1.72 



Rl. 234567 = .5660 



Experimental H=12 
Ruder(M) Ruder (C) Ruder (S) 



7.25 

1.42 



6.17 

1.82 



6.58 

1.75 



7.63 

1.27 



Hi. 234567 = .9159 

Co ntrol N=16 

6.63 

1.54 

Rl. 234567 = .5764 



8.13 

.99 



tinner Bucks - Auto-Mechanics 



Experimental K=9 



Final Beta Otis Bennett Ruder (M) Ruder (C) Ruder ( S) 



66.67 

14.13 



105.00 107.00 . 39.22 
8.35 8.11 8.74 



8.00 

1.15 



5.00 

.94 



5.00 

1.70 



Mean 

S.D. 



63.93 109.07 100.78 
13.33 7.13 9.97 

t = .0138 
.21 df .05 =2.080 



38.07 

7.50 



Rl. 234567 = .9737 

Control N=14 

4.85 
1.64 



7.36 *f.85 5.64 

1.76 1.64 1.23 

.R1234567 = .9040 . 
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FOURTH QUARTERLY REPORT 
PROJECT USOE 5-1332 



SUMMARY 



The lest research week at Bpper Bucks Technical High School coincided with 
the first week of 1967 as final proficiency examinations were ato^istercd 
to all electronics course students. The Autoi^chanlcs Course had be n 
eomnleted lust prior to Christmas vacation. The Trainer was moved from 
B^r Bucks to the Montgomery County Technical High School, . 

the computer-based programmed instruction in electronics *“® 
to these students (a suburban population) from 9 3 

On 26 February 1967 the USOE Project Director, Dr. Sidney C. High, 
the Montgomery County Technical High School and observed a demrastration of 
tte »te?SloL in tL Electronics course there. The Dobbiw School^ 
requested that the project return there in February, so their students in 
Electronics could have use of the trainer. While a second trainer was leased, 
there was no second set of electronic course slides as they had not been 
funded by USOEj as a result, it vas not possible to run two cwrses in 
paralleU Scores on the Upper Buck Electronics course Final Tests (E^eri- 
Lntal Mean® 69,25, Control Mean* 51.00) were fwjnd to be significantly^ 
different at the 2J level of confidence (t-tst). T-tests between high and 
low I.Q. group- students in Electronics were not significant. Indicating 
that the Methodology might be effective across the Otis I.Q. ®®"Se of 
students from 83-131 (this population). Depletion of funds terminated 
project activities the week of February 28, 1967. 






I 






% 




mm 









